Computer System for Converting Gestures to Text and Audio Messages
نویسندگان
چکیده
Today, there are quite a large number of deaf- mute and hard-of-hearing people which communicate using gestures. Therefore, it is simply necessary to provide them with modern means communication the surrounding world. This paper creates holistic computer system architecture for converting gestures into text audio messages. The principles construction basic design solutions based on element base increased productivity minimization hardware costs energy consumption have been developed. most popular existing gesture recognition considered analyzed. operation main components has described, principle functioning entire analyzed, their advantages disadvantages compared. latest structural building (both physical software) selected investigated. Physical features include: state-of-the-art Arduino Nano computing platform, HC-05 Bluetooth module, ADXL335 accelerometer, ZD10-100 Information sensor (flexibility sensor). Software firmware Python-based software splitting flow letters words, displaying them, voicing them. methods Google Media Translation API Text-to-speech (gTTS) expediency conducting research improved performance through use new information sensor, flexibility 500 g. general scheme all systems designed.
منابع مشابه
Converting Text into Agent Animations: Assigning Gestures to Text
This paper proposes a method for assigning gestures to text based on lexical and syntactic information. First, our empirical study identified lexical and syntactic information strongly correlated with gesture occurrence and suggested that syntactic structure is more useful for judging gesture occurrence than local syntactic cues. Based on the empirical results, we have implemented a system that...
متن کاملUsing Audio Books for Training a Text-to-Speech System
Creating new voices for a TTS system often requires a costly procedure of designing and recording an audio corpus, a time consuming and effort intensive task. Using publicly available audiobooks as the raw material of a spoken corpus for such systems creates new perspectives regarding the possibility of creating new synthetic voices quickly and with limited effort. This paper addresses the issu...
متن کاملVTalk: A System for generating Text-to-Audio-Visual Speech
This paper describes VTalk, a system for synthesizing text-to-audiovisual speech (TTAVS), where the input text is converted into an audiovisual speech stream incorporating the head and eye movements. It is an image-based system, where the face is modeled using a set of images of a human subject. A concatination of visemes –the corresponding lip shapes for phonemes— can be used for modeling visu...
متن کاملSpeaker identification based text to audio alignment for an audio retrieval system
We report on an audio retrieval system which lets Internet users efficiently access a large audio database containing recordings of the proceedings of the United States House of Representatives. The audio has been temporally aligned to text transcripts of the proceedings (which are manually generated by the U.S. Government) using a novel method based on speaker identification. Speaker sequence ...
متن کاملSieve Extension for Converting Messages before Delivery
This document describes how the "CONVERT" IMAP extension can be used within the Sieve mail filtering language to transform messages before final delivery. Information about the current status of this document, any errata, and how to provide feedback on it may be obtained at in effect on the date of publication of this document. Please review these documents carefully, as they describe your righ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Advances in cyber-physical systems
سال: 2021
ISSN: ['2524-0382', '2707-0069']
DOI: https://doi.org/10.23939/acps2021.02.090